Some Characteristics about the Weighted Minimum Description Length Criterion.

Minimum Description Length Criterion

he intelligibility of speech in communication systems is generally reduced by interfering noise. This interference, which can take the form of environmental noise, reverberation, competing speech, or electronic channel noise, reduces intelligibility by masking the signal of interest. The reduction in intelligibility is particularly troublesome for listeners with hearing impairments, who have gr...

Translation-invariant denoising using the minimum description length criterion

A translation-invariant denoising method based on the minimum description length (MDL) criterion and treestructured best-basis algorithms is presented. A collection of signal models is generated using an extended library of orthonormal wavelet-packet bases, and an additive cost function, approximately representing the MDL principle, is derived. We show that the minimum description length of the...

The Minimum Description Length

Minimum Description Length Principle

The minimum description length (MDL) principle states that one should prefer the model that yields the shortest description of the data when the complexity of the model itself is also accounted for. MDL provides a versatile approach to statistical modeling. It is applicable to model selection and regularization. Modern versions of MDL lead to robust methods that are well suited for choosing an ...

Pruning with Minimum Description Length

The number of parameters in a model and its ability to generalize on the underlying data-generating machinery are tightly coupled entities. Neural networks consist usually of a large number of parameters, and pruning (the process of setting single parameters to zero) has been used to reduce the nets complexity in order to increase its generalization ability. Another less obvious approach is to ...